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Analyses in the literature of digital communications often presuppose 
that the digital source is "while," that is, that it produces stochastically 
independent eguiprobable symbols. In this paper we show that it is possible 
to "whiten" to any degree all the first- and second-order statistics of any 
binary source at the cost of an arbitrarily small controllable error rate. 
Specifically, we prove that the self -synchronizing digital data scrambler, 
already shown effective at scrambling strictly periodic data sources, will 
scramble any binary source to an arbitrarily small first- and second-order 
probability density imbalance 8 if (i) the source is first passed through the 
equivalent of a symmetric memoryless channel with an arbitrarily small 
but nonzero error probability e, and (ii) the scrambler contains M stages 
where 

M ^ 1 + log 2 [(ln 25)/ln (1 - 2«)]. 
Some interpretations and applications of this result are included. 

I. INTRODUCTION AND SUMMARY 

Digital transmission systems often have impairments which vary 
with the statistics of the digital source. Timing, crosstalk, and equaliza- 
tion problems usually involve source statistics in some way. While 
redundant transmission codes may be used to help isolate system 
performance from source statistics, the isolation is not always complete, 
and such codes generate additional problems by increasing the required 
symbol rate or the number of levels per symbol which must be trans- 
mitted. In addition, with or without transmission codes, it is always 
easiest to analyze or predict system impairments if we assume that the 
source symbols are stochastically independent and equiprobable. We 
shall refer to such a source as "white" because of the obvious analogy 
to white Gaussian noise. Methods for "whitening" the statistics of 
digital sources without using redundant coding generally come under 
the heading of scrambling. 
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We describe here a nonredundant scrambling/descrambling method 
which in principle will satisfactorily whiten the statistics of any binary 
source. The technique is based upon the self-synchronizing digital data 
scrambler. Savage has shown 1 that this device is very effective at 
scrambling strictly periodic digital sources. In this paper it is proven 
that the same device will scramble any binary digital source to an 
arbitrarily small first- and second-order probability density imbalance 
5 if (t) the source is first passed through the equivalent of a binary 
symmetric memoryless channel with an arbitrarily small but nonzero 
error probability e, and (it) the scrambler contains M stages where 
M S 1 + log 2 E( m 2fi)/ln (1 — 2e)J- In other words, at the cost of an 
arbitrarily small controllable error rale, one can "whiten" to any degree 
all the first- and second-order statistics of any binary source. This relaxes 
the restriction frequently found in the literature in which the source is 
assumed a priori to produce only independent equiprobablc symbols. 
An auxiliary result is that the above relation for M is useful when 
designing a standard self-synchronizing scrambler for a given applica- 
tion. Heuristically speaking, the relation expresses the "power" of the 
scrambler by linking the "randomness" of the input and output to the 
scrambler length, M. 

In Sections II and III of this paper we examine some properties of 
scramblers, maximal length sequences, and mod-2 sums of binary 
random variables. With these discussions as background, we prove the 
main theorem in Section IV. In Section V we derive bounds for the 
autocorrelation of the scrambled sequence. Section VI contains some 
practical considerations involved in applying the theorem of Section 
IV. Beacuse they add insight, we give simple direct proofs for the 
lemmas and theorem of Sections III and IV. 

II. SCRAMBLERS AND MAXIMAL LENGTH SEQUENCES 

Figure 1 shows a five-stage self-synchronizing scrambler and de- 
scrambler. 1 As seen, both are linear sequential filters, the scrambler 
utilizing feedback paths and the descrambler feedforward paths. Each 
cell represents a unit delay. We restrict our attention to the binary 
case and use the symbols © and E to denote mod-2 addition. Repre- 
senting the data as shown, we have 

b k = a k © b*_a © bk-b 
and 

C k = b k © &A-3 © &fc-6 = dk, 

which shows that the descrambled sequence is identically equal to the 
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Fig. 1— (a) Five-stage scrambler, (b) Five-stage descrambler. 



original data sequence. The descrambler is self-synchronizing because 
the effect of a channel error, insertion, or deletion lasts only as long as 
the total delay of the register, five bit-intervals in this example. 

Let us consider the general scrambler of Fig. 2a with the input 
stream disconnected. Under such a condition, the scrambler becomes 
a sequence generator whose output must ultimately become periodic 
because (i) future states of the register are completely determined by 
the present state (the state of the register is the contents of its stages) 
and (ii) only the finite number 2 M states are possible, where M equals 
the number of stages. One of these, the all-zeros state, simply leads to 
an all-zeros output. Discounting this state, we see that the longest 
possible period from the generator must be 2 M — 1 bits. It is proven in 
the literature 2 - 3 that with the proper choice of feedback taps we can 
generate such a maximal length sequence for any M . 

Registers which generate maximal length sequences make very 
effective scramblers because of their ability to dissociate one scrambler 
output bit from another. This property will enable us to show that two 
arbitrarily chosen output bits tend to be very weakly correlated. We 
state this essential property here in the form of a lemma. 

Lemma 1: From Fig. 2a it is evident that each "b" bit is equal to a lengthy 
mod-2 summation of selected "a" bits. Choose two bits, b m and b n , m > n, 
and define J mn to be the number of "a" bits which enter the summation for 
b m but not the summation for b n . That is, b m is dissociated from b„ by the 
moo\-2 sum of J mn "a" bits. 

Then, if n > 2 M+l (that is, the scrambler has processed at least 2 M+1 
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Fig. 2— (a) A/-stage scrambler, (b) Af -stage descrambler. 



"a" bits), 



J = min [Jmn] = 2 J 



(1) 



In other words, after a settling time of 2 M+l bits, any chosen pair of 
output bits will differ by the mod-2 sum of at least 2 M ~ 1 input bits. 
Proof: See appendix. 

III. MOD-2 SUMS OF BINARY RANDOM VARIABLES 

Throughout this paper we assume that a data sequence may be 
modeled as a sequence of binary random variables denned on a suitable 
probability space. In this section we state as lemmas two essential 
properties of mod-2 sums of binary random variables. Since the 
scrambler output is formed from mod-2 sums of input bits, these 
properties play a key role in determining the scrambler output charac- 
teristics. We include the proofs in the text because the equations 
involved will be useful later on. 

Lemma 2: Consider two independent binary random variables n and r 2 . 
A third binary random variable n = r\ © r 2 . Let 



V> 



= p( r . = 1) = 1 - P( Ti = 0), • = 1, 2, 3. 
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Then 

I Pi - J I ^ min [ | p 2 - £ I , I Pi - £ I ] 

mto equality if and only if p x or p 2 = §, 0, or 1. /w oZ/ier words, r 3 is 
as c/ose or cZoser fo 6ez>20 eguiprobable than either r 2 or n. 

Proof: Since r x and r 2 are independent, 

p 3 = pt(l - Vi) + Pi(l - Pi). (2) 

Let 

d, - Pi - h i = 1, 2, 3. 
Then by substitution 

|d 3 | = 2|d,||d 2 |. 
But since 

1*1 ^i 

we have 

\d,\ ^min[|di|, |d,|] 

with equality if and only if \di\ or \d 2 \ = or |. 

Corollary to Lemma 2: Ifp x = \, then p 3 = \ and r 3 is independent ofr 2 . 

Proof: Since r 3 = n r 2 , P(r 3 = 1 |r 2 = 1) = 1 - p x = \. But by eq. 
(2), Vz = i Thus, P(r 3 = l|r 2 = 1) = P(r 3 = 1) = \, which implies 
r 3 and r 2 are independent. 

Lemma 3: Consider now a sequence of independent binary random 
variables {r k , k = 1, 2, ■ • • } with 

P(r k = 1) = 1 - P(r k = 0) = e for all k. 
We form the mod-2 sum 



Rn = E r k (3) 

*=i 

and let P n = P(R n = 1). Then 

Pn = i[l - (1 - 2 C )«]; n ^ 1. (4) 

Note that, as n — >», P n converges to % for all < e < 1. However, 
we shall be concerned only with finite values for n. 

Proof: By applying eq. (2) repeatedly, it is easily shown that the 
sequence P„ satisfies 

P n = (1 - 2 e )P„_ 1 + e; n ^ 2, 

and 

Pi = e. 
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The solution to this first-order linear difference equation is given by 
eq. (4). 

IV. A UNIVERSAL DIGITAL DATA SCRAMBLER 

With the help of the lemmas, we may now derive the main result. 
We model the source as a device which generates a sequence of binary 
random variables j s k } with completely unknown statistics. Our goal is 
to find a scrambling/descrambling method such that the scrambled 
sequence {&*} will have statistics which approach those of the inde- 
pendent equiprobable ("white") sequence [w k \. If we attempt to 
scramble [s k ] directly as in Fig. 2, we are faced with a dilemma. The 
scrambler simply provides a one-to-one mapping between its input and 
output. As long as we have no knowledge or control of the statistics of 
{s k \, the statistics of {b k \ must likewise remain unknown and uncon- 
trolled. Hence, the self-synchronizing scrambler alone cannot be 
universal. 

Instead of scrambling directly, we proceed as shown in Fig. 3. The 
source output is first passed through the equivalent of a binary sym- 
metric memoryless channel (BSC) with crossover probability e > 0. 
Remarkably, no matter how small e may be, this modification of the 
source sequence is sufficient to guarantee that the first- and second- 
order probability densities for \b k \ will approach those of {w k \ to 
within an arbitrarily small difference 8. The only requirement is that 
M, the length of the scrambler, be dependent upon the choice of c and 
8. This is the essence of the theorem which we derive below. (We note 
in passing that the descrambled sequence will now differ from the 
original source sequence by the error rate e, but since e may be chosen 
arbitrarily small, we assume for now that this is of no consequence.) 

To begin, we observe that because of the BSC the scrambler input 
sequence may be written 

a k = s k ® n, k = 0, 1, 2, • • • , (5) 

where 

P(r k =1) =1 - P(n =0) = €. 

From Lemma 1 we have seen that the action of the M-stage scrambler 
is to dissociate any chosen pair of bits (b m , b n ) by the mod-2 sum of at 
least 2 M ~ l "a" bits. Let us assume that b m and b n are dissociated by 
exactly 2 Af_1 "a" bits and that they are related by 



,u-i 



b m =b n ® 2 E at. (6) 
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(b) 
Fig. 3 — (a) Universal scrambler, (b) Descrambler. 
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(Here the subscript I is unrelated to the original position of ai in the 
scrambler input stream.) In what follows we show that P(b m = 1) ^ i 
and that b m and b n are nearly independent. For these purposes the use 
of eq. (6) represents a worst-case analysis. By substitution from eq. 
(5) we may write 



[2«-> "i r 2»-» i 
b n E 8 1 © In 



(7) 



A 



® R 



where A and R equal the first and second bracketed terms, respectively. 
Since the bits comprising R are independent from those comprising A, 
R is independent of A. Furthermore, by Lemma 3, 

P(R = 1) = |[1 - (1 - 26)2-']. (8) 

Therefore, by Lemma 2, no matter what the value of P(A =1), 

5' = \P(b m - 1) - || ^ |[(1 - 2e) 2W -'] = 5. (9) 

It follows that so long as e > we may force 8 and 8' to be arbitrarily 
small by choosing a large enough M . Specifically, for a given 5, 

In 25 



M ^ 1 + log 2 



In (1 - 2e) 



< e < |. 



(10) 



Since 5 may be made arbitrarily small, the density function p(b m ) may 
be made nearly white, and it follows that all first-order statistics of the 
scrambled sequence may be made nearly white. 

Our having shown P(b m = 1) tt \ does not by itself show that the 
source has been effectively scrambled. For example, consider a sequence 



1858 THE BELL SYSTEM TECHNICAL JOURNAL, DECEMBER 1973 

[x n ] which consists of consecutive blocks of 100 symbols each. All the 
symbols in each block are alike; with probability § they are all ones, 
and with probability 5 they are all zeros. Here P(x n = 1) = \ for all n, 
yet the sequence has a very "nonrandom" nature. The implication is 
that to determine the effectiveness of the scrambler, we must also 
evaluate the statistical dependence between scrambler output bits. 
By definition, the variables b m and b n are independent if 

p(b m , K) - p(b m )p(b n ) = 0. 
Accordingly, we define the function 

d(b m , b n ) m p(b m , b n ) - p(b m )p{b n ) 

= p(b m \b n )p(b n ) - p(b m )p(b n ) (11) 

and show that the universal scrambler (Fig. 3) bounds the maximum 
value of I d(b m , b n ) \ . 

We do a worst-case analysis by assuming that b m and b„ are related 
by eq. (7). Further, we ignore the "s" bits appearing in eq. (7) because, 
being independent of R, they can only weaken the dependence between 
b m and b n . Hence, we may compute the maximum value of | d(b m , b„) \ 
by assuming 

b m = b n R. (12) 

From eqs. (8) and (9) we note P(R = 1) = % - 8 and for con- 
venience we temporarily let P(b n = 1) = b. Substituting these rela- 
tions and eq. (12) into eq. (11), we find that 



for 



\d(b m ,b n )\ =25[6(1 - &)]; 
b m) b n =0,1; m > n > 2 M+1 . 
Hence, for b = % we obtain the general result 

|d(&»,6n)|m« = 8/2. 

Since 8 may be forced arbitrarily small if M is given by eq. (10), it 
follows that any pair of output bits may be made nearly independent, 
and we may whiten to any degree all the second-order statistics of the 
source sequence. 

We may also show that the joint (second-order) density p(b m , b n ) 
approaches that for the white sequence. The derivation of eqs. (6) to 
(9) shows that both the density p(bi) and the conditional density 
p(bi\bj) must have values on the interval [(£ — 8), {\ + 8)~] for all 
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Fig. 4 — Scrambler stages required as a function of e and 5. 

possible values of 6, and by. Hence, 

(h - 5) 2 ^ p(b m , b n ) = p(& m [6 n )p(6 n ) ^ (i + 5)2, 



or 



where 



\p(b m ,b n ) -i\ ^ 8 + 5 2 f^5, 
6 m , b n =0,1; m> n> 2 M+1 . 



For the white sequence { Wk ) , we know p(iv m , w n ) = | for w m , w n = 0, 1. 
Thus the joint density p(b m , b n ) may be whitened to any degree by 
choice of 5, e, and M. 

The discussion above constitutes a proof of the following theorem. 

Universal Scrambler Theorem: A binary source with unknown output 
statistics is connected to a binary symmetric memoryless channel and an 
M -stage self-synchronizing scrambler as shown in Fig. 8. The channel has 
error 'probability e where < e < \. The scrambler output is represented 
by a sequence of random variables [b n , n = 0, 1, • • • } and we define 
p(b„) to be the first-order and p(b m , b n ) the second-order density functions 
for {&„}. Then for all 8 > 0; m > n > 2 M+1 , and b m> b n = 0, 1, 



and 



\p{b n ) ~\\ £8, 
\p(b m ,b n ) - || ^ 8 + 8', 



(13) 
(14) 
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provided that 

** J + 1 * [firing] ' (1S) 

Figure 4 shows the relation between M, e, and 5. As seen, M is 
primarily dependent upon e. This may be clarified by rewriting eq. 
(15) for small values of e. We then obtain 

M ^ log 2 (1/e) + log 2 [In (1/25)]; e « i 

The primary importance of this theorem is conceptual. To avoid 
inordinate difficulties, many analyses in the literature of digital trans- 
mission must assume a priori that the digital source is white. The 
theorem relaxes this restriction by showing that in concept the first- 
and second-order statistics of any source may be made asymptotically 
white. The practical application of this theorem is discussed in 
Section VI. 

V. AUTOCORRELATION OP THE SCRAMBLED SEQUENCE 

An important second-order statistic of the scrambled sequence is its 
autocorrelation. We define the autocorrelation as the expectation 

R(k) = E[b n bn+ k 2, 

and for convenience we let the value of b n be +1 or —1. Clearly, 
R(0) = 1. For k ?* 0, we compute a bound on \E\jb n b n+ k]\. Following 
the argument which led to eq. (12), we have 

| #[&„&„+*] | ^ \E[b n (b n 72)] |; n, n + k ^ 2 M+l , k ^ 0. 

By definition, 

E[b n b m 2 = 11 ijP(b m = i\b n = j)P(b n = j). 

» 3 

We let b m = b„ © R and for convenience 

P(b n = 1) =b = 1 - P(b n =-1). 
Substituting, the dependency on b vanishes, leaving us with 
E[b n (b n © R)2 = 28. 



Hence, 



R(k) = 1 


for k = 0, 


R(k) | ^ 25 


for k ^ 0. 



(16) 



Note that, by forcing 5 to a small value with proper choice of M and 
e, this autocorrelation approaches that for a "white" digital source 
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Fig- 5 — (a) Autocorrelation for white sequence \w k \. (b) Autocorrelation bound 
for scrambled sequence |6*|. 

which has R(k) = 0, k ^ 0. This is shown graphically in Fig. 5 which 
shows the autocorrelation of "white" and scrambled sources for unit 
rectangular pulses. 

VI. PRACTICAL CONSIDERATIONS 

In practice, the binary symmetric channel required by the theorem 
might be implemented as shown in Fig. 6. The bit r k is a logic "one" 
only when the level from the noise generator exceeds some threshold. 
The threshold is set such that P(r k = 1) = e. The noise source need 
not be white, but values of n(t) separated by the baud interval should 



NOISE 
GENERATOR 




n(t) 


THRESHOLD 
DETECTOR 




•> r 


-\ \- 


s k ©r 








J 






















CLOC 


7L 




DIGITAL 






11 




SOL 


RCE 





Fig. 6 — One possible implementation of the BSC. 
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be independent. In principle, the combination of this simulated BSC 
and an Af-stage self-synchronizing scrambler will form a universal 
scrambler capable of satisfactorily whitening the statistics of any 
binary source. Such a scrambling structure could be used wherever 
randomized bit statistics are essential and a small error rate can be 
tolerated (or perhaps corrected by an error-correcting code). 

There are, of course, good reasons to avoid actual implementation of 
the BSC. First, it may be difficult to generate the r k sequence accu- 
rately if e is very small. Second, the deliberate generation of errors, if 
not impractical, is at least unpalatable. Third, and most important, 
many commonly encountered sources do not need it. Self-synchronizing 
scramblers have been used successfully without any prior randomiza- 
tion of the source. 4 In this section we consider the operation of the 
scrambler without the BSC and show how a designer may use eq. (15) 
to estimate the required scrambler length for a given application. 

From eqs. (2) and (5) we deduce that the net effect of the binary 
symmetric channel in Fig. 3 is 

6 < p(a h \a , a h ■ • ■ , a*_i) < 1 — «; a* = 0, 1, (17) 

for all k. In other words, because of the BSC there remains a small 
uncertainty as to the value of any "a" bit, even though all the other 
"a" bits might be known. As shown in the theorem, this and the 
dissociation property are sufficient to guarantee effective scrambling. 
Hence, if the designer knew to begin with that the source itself had the 
characteristic 

e < p(s k \s , Si, • • • , s t _i) < 1 - e; S k = 0, 1, (18) 

then no BSC would be necessary, and eq. (15) could be applied directly. 
For example, bit streams encoded from analog waveforms (such as 
frequency-division multiplexed speech) often have such a property, and 
a value for e could be obtained from the coding rule and the amplitude 
distribution of the analog signal. 

For those cases in which a value for e cannot be computed, let us 
assume that the designer has at least some knowledge of the source 
pulse density. He could then proceed by estimating a nominal value for 
e and then decreasing the value to allow some margin. For example, a 
source which produces bit streams known to vary from 10 to 90 percent 
"ones" over short periods (say, several hundred bits) would have a 
nominal e =0.1. It seems reasonable to allow at least one order of 
magnitude "margin" in the estimate, resulting in e = 0.01. Then from 
Fig. 4 we see that an eight-stage scrambler should be sufficient. 
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Of course, estimating e from the source pulse density does not 
guarantee that eq. (18) really holds, but if the source sequence is not 
strictly periodic (the case covered comprehensively by Savage), it is a 
reasonable procedure. The point here is that even when we are un- 
willing to commit deliberate errors to guarantee fixed source statistics, 
we may still use eq. (15) to estimate how large a scrambler is required. 
Heuristically speaking, eq. (15) is an expression for the "power" of 
the scrambler, relating the "randomness" of the input and output to 
the number of scrambler stages. 

VII. CONCLUSIONS 

We have shown that at the cost of an arbitrarily small error rate it is 
possible to "whiten" to any degree all the first- and second-order 
statistics of any binary digital source. This relaxes the restriction 
frequently found in the literature in which the digital source is assumed 
a priori to produce only independent equiprobable symbols. The key 
equation in our result [eq. (15)] is useful when designing a standard 
self-synchronizing scrambler for a given application. 

We leave unsolved the problem of whether universal scramblers exist 
for the M-ary source. 
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APPENDIX 

Proof of Lemma 1* 

For convenience, we assume that in Fig. 2a the scrambler initially 
contains all zeros. Since each scrambler output bit is ultimately a 
mod-2 summation of selected input bits, we may write 

b« = E h k a n - k , (19) 

fc=0 

where the binary sequence h k performs the selection. We note that if 
a = 1 and a, = for all i > 0, then [b n ] = {h n \. But under these 



* Independently of the author, U. Henriksson has developed 5 a proof of a similar 
lemma. 



1864 THE BELL SYSTEM TECHNICAL JOURNAL, DECEMBER 1973 

conditions, as described in Section II, {&„} will be a maximal length 
sequence. Hence, {h„\ must itself be a maximal length sequence. 

Now we consider the two output bits b„ and b m . We wish to count 
the number of "a" bits which entered the summation for b m but not 
b n . We have 

n m 

b n = E htOn-k b m = E h k a m - k . (20) 

fc=0 *=0 



(a) (b) 



Since m > n, 



m—n—l m 

b m = E A*o M _t © E h k a m - k 

k=0 k = m—n 

m—n—l n 

= E h k a m - k ® E h m - n+k a„-k (21) 

A=0 fc=0 

Examination of the subscript range shows that all the "a" bits 
selected by the first summation in eq. (21) are unique to b m . By com- 
paring the second summation with eq. (20a) we see that the additional 
"a" bits which enter b m but not b„ are those for which 



Hence, 



h m -n+k — h m - n+k h k — 1. 



m—n—l n 

Jmn = ]C hk + 2w \_hm-n+k — h m - n+k h k J, 

A-=0 k=0 



or 



m—n—l n n 

J mn = Z h + £ h m -H+k - E h m -n+khk, (22) 

where addition is now in the usual sense. 

We examine this expression in detail, recalling that the sequence 
[hk\ has period p = (2 M — 1) and the given condition n > 2 Jf+1 . 

Case (1) : If m - n = Kp, K = 1, 2, • • • , then 

/ifc = /lm-n+* — hm-n+khk 

for all values of fc. Hence the second and third summations cancel. But 
then the first summation contains K periods of a maximal length 
sequence. Since each period contains exactly 2 ( - M ~ l) ones, 6 the first 
summation totals at least 2 (M-1) . 

Case (2) : II m — n 9^ Kp, then it is easily shown 6 that the sequence 
formed by the term-by-term product h m - n+k h k has period p and con- 
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tains 2 {M ~ 2) ones per period. The sequence {/i m -n+*} contains 2 (M ~ 1) 
ones per period. Hence the net contribution of the second and third 
summations is 2 (Af_2) ones per period. Since n > 2 Af+l > 2p, the 
summations cover at least two periods. Thus their net total is at least 

Thus for either case, 

Jo = min [J mn ] = 2"-K 

m,n>2*-M 

REFERENCES 

1. Savage, J. E., "Some Simple Self-Synchronizing Digital Data Scramblers," 

B.S.T.J., 45, No. 2 (February 1967), pp. 449-487. 

2. Gallager, R. G., Information Theory and Reliable Communication, New York: 

John Wiley and Sons, 1968, pp. 225-238. 

3. Peterson, W. W., Error Correcting Codes, Cambridge: M.I.T. Press, 1961, pp. 

251-270. 

4. Fracassi, R. 1)., and Tammaru, T., "Megabit Data Service with the 306A Data 

Set," Bell Laboratories Record, 4U, No. 10 (November 1971), pp. 310-315. 

5. Henriksson, U., "On a Scrambling Property of Feedback Shift Registers," IEEE 

Trans, on Commun., 20, No. 5 (October 1972), pp. 998-1001. 

6. Golomb, S. W., Shift Register Sequences, San Francisco: Holden-Day, 1967, pp. 

23-59, 88. 



